Skip to main content

Partial Derivatives Formal

The concept of partial derivatives can be beautifully elucidated by considering how a function changes as we vary one of its input variables while keeping others fixed. This idea is especially intuitive in the realm of multivariable functions, where different directions of change give rise to unique behavior in the function's output.

Formal Definition of Partial Derivative

Given a multivariable function f(x,y)f(x,y), the partial derivative of ff with respect to xx at a point (x0,y0)(x_0, y_0) is given by:

fx(x0,y0)=limh0f(x0+h,y0)f(x0,y0)h\frac{\partial f}{\partial x}(x_0, y_0) = \lim_{{h \to 0}} \frac{f(x_0+h, y_0) - f(x_0, y_0)}{h}

This equation gives a precise meaning to the rate of change of the function in the $ x -direction at the point $(x_0, y_0).

Intuitive Explanation

Let's try to build an understanding of this definition:

  1. Starting Point: We begin at a point (x0,y0)(x_0, y_0) in the domain of ff.

  2. Tiny Step in xx-direction: Choose a minuscule value, hh. Add hv1h\blueE{v_1} to x0x_0, translating to the point (x0+hv1,y0)(x_0 + h\blueE{v_1}, y_0). From our understanding of partial derivatives, the function's output will now change by approximately:

    hv1(fx(x0,y0))h\blueE{v_1} \left(\frac{\partial f}{\partial x}(x_0, y_0) \right)
tip

**Why are we multiplying by hv1h\blueE{v_1}? See at the bottom of the article for a more in-depth explanation.

  1. Tiny Step in yy-direction: Now, introduce a small increment, hv2h\greenE{v_2}, to y0y_0, which moves us to the point (x0+hv1,y0+hv2)(x_0 + h\blueE{v_1}, y_0 + h\greenE{v_2}). The ensuing change in ff is approximately:

    hv2(fy(x0+hv1,y0))h\greenE{v_2}\left( \frac{\partial f}{\partial y}(x_0 + h\blueE{v_1}, y_0) \right)
  2. Combining the Effects: The cumulative alteration to the function, stemming from the movements in both the xx and yy directions, is close to:

    hv1(fx(x0,y0))+hv2(fy(x0+hv1,y0))h\blueE{v_1} \left(\frac{\partial f}{\partial x}(x_0, y_0) \right) + h\greenE{v_2}\left( \frac{\partial f}{\partial y}(x_0 + h\blueE{v_1}, y_0) \right)
  3. Relating to Directional Derivative: The expression above is reminiscent of the definition of the directional derivative, which encapsulates the change in ff due to the step hvh \mathbf{v}:

    hvf(x0,y0)=hvf(x0,y0)=hv1fx(x0,y0)+hv2fy(x0,y0)h \nabla_{\mathbf{v}} f(x_0, y_0) = h \mathbf{v} \cdot \nabla f(x_0, y_0) = h\blueE{v_1}\frac{\partial f}{\partial x}(x_0, y_0) + h\greenE{v_2}\frac{\partial f}{\partial y}(x_0, y_0)
  4. Limiting Behavior: The above explanation has a minor discrepancy: the partial derivative concerning yy is evaluated at (x0+hv1,y0)(x_0 + h\blueE{v_1}, y_0), not (x0,y0)(x_0, y_0). But remember, hh is infinitesimally small, and we're technically pondering the limit as h0h \to 0. If ff is continuous, then evaluating fy\frac{\partial f}{\partial y} at points arbitrarily close to each other, like (x0+hv1,y0)(x_0 + h\blueE{v_1}, y_0) and (x0,y0)(x_0, y_0), will yield almost identical results. As hh inches towards zero, this difference vanishes.

In essence, partial derivatives offer a lens through which we can observe and quantify the nuanced ways in which functions transform as their input variables undergo minute changes. They serve as foundational building blocks in understanding the more intricate behaviors of multivariable functions.

##Step 2 Explanation

Imagine the v1\blueE{v_1} and v2\greenE{v_2} represent the components of a directional vector v\vec{\textbf{v}} in the xx and yy directions, respectively. Specifically, if v=[v1v2]\vec{\textbf{v}} = \begin{bmatrix} \blueE{v_1} \\ \greenE{v_2} \end{bmatrix}, then v1\blueE{v_1} is how much we move in the xx-direction for a unit step in the direction of v\vec{\textbf{v}}, and v2\greenE{v_2} is the corresponding movement in the yy-direction.

To clarify further:

  • hh represents a small scalar value used to denote a tiny step's magnitude.
  • v1\blueE{v_1} is a scalar component of the directional vector v\vec{\textbf{v}}, indicating the amount of movement in the xx-direction for a unit step in the direction of v\vec{\textbf{v}}.

Their product, hv1h\blueE{v_1}, gives the actual displacement in the xx-direction when moving a tiny step of size hh in the direction of v\vec{\textbf{v}}. This displacement is a scalar value that we add to the xx-coordinate of the starting point to determine our new position.

###Partial Derivatives * hv1h\blueE{v_1}?

OK - Now we understand that hv1h\blueE{v_1} represents we can talk about why the multiplication of hv1h\blueE{v_1} to the partial derivative starting from it's definition.

1. Definition of Partial Derivative:
The partial derivative fx\frac{\partial f}{\partial x} at a point (x0,y0)(x_0, y_0) represents the rate of change of the function ff with respect to the xx-variable, while keeping yy constant. In simple terms, it tells us how much ff changes for a tiny change in xx.

2. Intuition of Multiplication:
Imagine you know that for every meter you walk eastwards, you ascend 5 meters in altitude. If you decide to walk 2 meters eastwards, you'd expect to ascend 5×2=105 \times 2 = 10 meters. The rate of ascent (5 meters per meter walked) is analogous to the partial derivative, and the distance you decide to walk (2 meters) is analogous to hv1h\blueE{v_1}.

3. Using the Rate of Change:
By multiplying the partial derivative (rate of change) by a small change in the input variable (in this case xx), you get the approximate change in the output of the function. Algebraically:

Change in ffx×Change in x\text{Change in } f \approx \frac{\partial f}{\partial x} \times \text{Change in } x

4. Applying to the Context:
In our context, the "Change in xx" is hv1h\blueE{v_1} which is a small step in the xx-direction. So, the multiplication:

hv1(fx(x0,y0))h\blueE{v_1} \left( \frac{\partial f}{\partial x}(x_0, y_0) \right)

gives the approximate change in the function ff due to a small step of hv1h\blueE{v_1} in the xx-direction. This is an application of the concept of a differential, which provides a linear approximation to the change in the function.

To summarize, multiplying the partial derivative by hv1h\blueE{v_1} gives us the expected change in the function value when we change our input by a tiny amount hv1h\blueE{v_1} in the direction of the vector v\vec{\textbf{v}}.